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(57) Abstract 

Systems and methods for selecting and inserting advertise- 
ments in an information document displayed to a user, wherein 
the selection is based at least in part oa television progiamming 
viewed by the user. The systems and medwds may be imple- 
mented using the Internet another infomiation retrieval system 
that includes a client system (10) and a remote server (16). The 
client system (10) monitors television programming (52) yiewed 
by Ac user and compiles a user profile (54) characterizing the tele- 
vision programming. When the user requests an Internet resource 
using the client system (10), the television programming informa- 
tion in the user profile (54) is utilized (64) to select an appropriate 
advertisement (78). The advertisement (78) is then inserted (76) 
in the information document (22) and displayed (20) to the user. 
Such selection of advertisement increases the efficiency by which 
Internet advertisements are tailored to individuals. Instead of ad- 
vertisements, information relating to the television programming 
may be retrieved over the Internet and displayed without direct 
user assistance. 




TELEVRION 
KOGRAVHtNG 
SOURCE 



a- - \m\ 





mm 






ami 





FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of panqjhlcls publUhing international applications under the PCT. 



AL Albania 

AM Aimenia 

AT Austria 

AU Aastralia 

AZ Azeitdjan 

BA Bosnia and Herzegovina 

BB Bafbados 

BE Belgian! 

BF Burkina Faso 

BG Bulgaria 

BJ Benin 

BR Brazil 

BY Belarus 

CA Canada 

CF Ctntra! African Republic 

CX; Congo 

CH SwUzerland 

a Cflte d'lvoire 

CM Cameroon 

CN China 

CU Cuba 

CZ Czech Republic 

DE Germany 

DK Denmark 

EE Estonia 



ES 


Spain 


LS 


Lesotho 


SI 


FI 


Finbmd 


LT 


Lithuania 


SK 


FR 


France 


LU 


Loxembourg 


SN 


GA 


Gabon 


LV 


Latvia 


SZ 


GB 


United Kingdom 


MC 


Monaco 


TD 


GE 


Oeoigia 


MD 


Republic of Moldova 


TG 


GH 


Ghana 


MG 


Madagascar 


TJ 


GN 


Guinea 


MK 


The fonner Yugoslav 


TM 


GR 


Greece 




Republic of Macedonia 


TR 


HU 


Hungary 


ML 


Mall 


TT 


IE 


Ireland 


MN 


Mongolia 


UA 


IL 


Israel 


MR 


Mauritania 


UG 


IS 


Iceland 


MW 


Malawi 


US 


IT 


Tuly 


MX 


Mexico 


UZ 


JP 


Jjqpan 


NE 


Niger 


VN 


KE 


Kenya 


NL 


Nedierlands 


YU 


KG 


Kyigyzstan 


NO 


Norway 


ZW 


KP 


Democratic People's 


NZ 


New Zealand 






Rq)ublic of Korea 


PL 


Poland 




KR 


Republic of Korea 


PT 


Portugal 




KZ 


Kazakstan 


RO 


Romania 




LC 


Saint Luda 


RU 


Russian Federation 




U 


Liechtenstein 


SD 


Sudan 




LK 


Sri Lanka 


SE 


Sweden 




LR 


Liberia 


SG 


Singapore 





Slovenia 

Skyvakia 

Senegal 

Swaziland 

Chad 

Togo 

Tajikistan 

T^ukmenistan 

T^nkey 

Trinklad and Tobago 

Ukraine 

Uganda 

United States of America 

Uzbekistan 

Viet Nam 

Yugoslavia 

Zimbabwe 



wo 00/54504 



1 



PCT/USOO/05326 



SYSTEM AND METHOD OF INSERTING ADVERTISEMENTS INTO AN 
INFORMATION RETRIEVAL SYSTEM DISPLAY 
BACKGROUND OF THV. INVRNtton 

1. The Field of the Invention 

The present invention relates to advertising on an information retrieval system. 
In particular, the present invention relates to systems and methods of selecting 
advertis^ents and displaying the selected advertisements on an information retrieval 
system based at least in part on the television viewing habits of the redpient of the 
advertisements. 

2. The Prior State of the Art 

The Internet, and paiticulariy the World Wide Web ("Web"), has experienced 
tremendous growth during recent years. The Wd) allows users to retrieve and access 
text, graphics, audio, video, and other information from remote servers. The Web has 
become a valuable source of news, educational resources, commercial information, 
oitertainment, and the like. Many, if not most, Web sites are accessible by users free 
of charge. Other sites are made available to users for a small fee. Many Web sites 
subsidize part or all of the cost of maintaining a server, posting information in Web 
pages, etc. by selling and distributing advertisements embedded in Web pages. 

As in other advertising applications, it has been found that advertisements in 
Web pages are most eflfective if they can be tailored and directed to segments of the 
population that are likely to be interested in the advertised goods and services. 
Because of the interactive nature of the Internet and the ability to easily insert 
graphical images in Web pages, there have been developed several methods of 
targeting Internet advertisements to specific users or specific groups of users. 

One of the simplest methods of tailoring Internet advertisements to recipients 
is similar to techniques used in television, radio and other media. In particular, 
advertisements are selected to correspond to the subject matter of the Web page or 
other Internet resource. It is assumed that users who actively retrieve Internet 
resources dealing with a certain topic are more likely than the population at large to 
be receptive to advertisements directed to the topic. For example, if a Web site relates 
to travel information, advertisers and Web site providers can generally assume that 
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users accessing the Web site vnSl have a heightened interest in travel-related 
advertisements. 

Advertisements are particularly attractive in the Internet environment for 
several additional reasons. First, Internet usere are typicaUy actively and attentively 
taking in information when they access Internet resources. Such users may be more 
receptive to messages deUvered by advertisers than persons engaged in other 
activities. Second, because of the interactive nature of the Internet, recipients of 
advertising may choose to receive a smaU amount or a relatively large amount of 
information on the advertised goods or services. For example, a typical Internet 
advertisement may consist of a bamier box or another graphical image identi^g the 
goods or services or presenting a concise advertising message. Moreover, the 
graphical image is frequently an active link that may be selected by the user in order 
to access a Web site specifically dedicated to the advertised goods or sendees. 
Accordingly, interested recipients may easily retrieve additional information relating 
to advertiser's message. whUe disinterested recipients are not inconvenienced by too 
much unwanted information. The multimedia aspect of tiie Internet also allows 
advertisers to present their messages in new and interesting ways. 

In addition to basing advertisement selection on tiie subject matter of Web 
sites, advertisers have also been able to learn of some preferences and habits of 
recipients in order to more effectively tailor advertisements. Many Web sites 
download "cookies" to users' computers when users access the Web sites. Cookies 
are files installed and stored on tiie hard disk of cUent computers and are used to 
report information relating to the cUent computer to Web site content providers. In 
one example, a cookie may merely be an identifier that transmits a user password or 
otiier identifying information each time the user returns to the Web site, thereby 
eliminating ti,e need for the user to remember and enter tiie password. In another 
example, however, cookies can be used to track and report the user's Internet habits, 
giving content providers and advertisers insight into the possible interests of the user, 
and allowing advertisements to be tailored accordingly. 

Services that automatically provide news and other information to recipients 
over the Internet have also become common. For example, there are many e-mail 
services and otiier Internet-based systems that periodically send messages or otiier 
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infonnation documents relating to specific topics to interested persons. Generally, 
such services provide information to recipients who have placed their names in a 
subscriber Ust. There is typically no attempt to individually taUor the information sent 
to the subscribers based on the subsaibers' particular preferences other than perhaps 
an interest survey submitted by the subscribers. 

In view of the foregoing, advertising techniques adapted fi-om other media 
have been widely used to tailor advertisements to broad segments of the Internet- 
using population. Furthermore, interactive techniques, such as those involving 
"cookies", aUow advertisers to learn of some of the recipient's habits as they relate to 
browsing Internet and otherwise using the recipient's computer. While such 
infonnation increases the efficiency by which advertisers may target specific 
redpients, any fiirther source of infonnation relating to individual habits and 
preferences would be a valuable improvanent in the Interna advertising industry. 

From the standpoint of the advertiser, any increase in the ability to narrowly 
target recipients would make advertising on the Internet more attractive. Internet 
content providers would also fevor advancements in advalising eflFectiveness, since 
they would then coUect more advertising fees fi-om advertisers. FinaUy, the Internet- 
using pubUc benefits fi-om being more effectively targeted in at least two ways. First, 
advertising recipients would be more likely to receive advertising information that is 
of interest and value. Second, a greater number and variety of Internet sites are likely 
to be profitable using improved advertising techniques, thereby making more no-cost 
and low-cost Internet sites available to the public. 

SUMMARY OF THE INVENTinN 

The present invention relates to selecting advertisements and displaying the 
selected advertisements on a display screen of an infonnation retrieval system based 
at least in part on the television viewing habits of the recipient of the advertisements. 
For example, the infonnation retrieval system may be the Internet, with the 
advertisements being embedded and displayed in a Web page or another Internet 
resource. Monitoring the television viewing habits of the recipient allows the 
advertisements to be more eflfectively taUored to the specific habits and preferences of 
the recipient. 
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The invention may be implemented in an information retrieval system 
including a cUent tenmnal and a remote server configured to communicate one with 
another. In Internet implementations, an Internet service provider ('TSP") may also 
be present in order to faciUtate and route information transmission over the system. 
Moreover, the client terminal is connected to, associated with, or otherwise has access 
to a television set or a television programming feed. According to the invention, the 
client terminal monitors television programming viewed by tiie user, and includes the 
television viewing habits in a user profile. 

When tiie user requests an information document, such as a Web page, from a 
remote server, the user profile is used in conjunction with selection criteria to select 
an advertisement appropriate for the user. Data representing the selected 
advertisement is inserted into the information document, and when tiie information 
document is displayed to tiie user, tiie selected advertisement is also displayed. The 
process of selecting and inserting tiie advertisement may be conducted according to 
any of at least three metiiods. In particular, tiie advertisement selection and insertion 
may be conducted at the client computer, at tiie server computer, and in Internet 
implementations, at tiie ISP. Moreover, selection and insertion may be conducted at 
amy combination of the foregoing sites. 

The foregoing metiiods of advertisement selection and insertion more 
generally extend to selection and display of any type of information to a recipient 
based at least in part on television viewing habits. As described herein, the client 
terminal monitors television programming viewed by tiie user and compiles a user 
profile. The user profile is compared against a list of information categories, which 
may be standard or user-defined. One or more of tiie infonnation categories that 
correspond to the user profile are tiien used to request information documents from 
the server computer. For example, the invention may be implemented in an Internet 
news delivery service wherein tiie information categories correspond to particular 
categories of news stories. Accordingly, information such as news, entertaimnent, 
educational resources, and the like, may be selected based at least in part on the 
television viewing habits of tiie recipient, automatically retrieved, and made available 
to the recipient. 
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In view of the foregoing, the invention disclosed herdn provides methods and 
systems for tailoring advertisements and other information to specific recipients in 
ways that have not previously been possible. Monitoring the television viewng 
habits of recipients allows advertisers and content providers to gain valuable insight to 
the preferences of the users. Accordingly, the advertisements or other selected 
information is more likely to be relevant and of interest to the recipient using the 
invention than using conventional methods. 

Additional advantages of the invention wHl be set forth in the description 
v^ch follows, and in part wiU be obvious fi-om the description, or may be learned by 
the practice of the invention. The advantages of the invention may be realized and 
obtained by means of the instruments and combinations particulariy pointed out in the 
appended claims. These and other featiires of tiie present invention wiU become more 
fiilly apparent fi^om tiie following description and appended dwms, or may be learned 
by the practice of the invention as set forth hereinafter. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In order that the manner in v^ch the above-recited and other advantages of 
the invention are obtained, a more particular description of the invention briefly 
described above will be rendered by referraice to specific embodiments thereof v^diich 
are illustrated in the appraided drawings. Understanding that these drawings dq)ict 
only typical embodiments of the invaition and are not therefore to be considered 
limiting of its scope, the invention will be described and explained with additional 
specificity and detail through the use of the accompanying drawings in which: 

Figure 1 is a schematic diagram illustiiating a networic system in which the 
invention may be implemented, wherein the network system includes client terminals, 
servers, and a television programming source. 

Figure 2 is a schematic diagram of one embodiment of a client system for use 
with the invention. 

Figure 3 A is a schematic diagram depicting a first embodiment of the systems 
and methods of the invention, wherein an advertisement is selected and inserted into 
an information document at the server computer. 
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Figure 3B is schematic diagram showing a second embodiment of the systems 
and methods of the invention, wherein an advertisement is selected and inserted into 
an information document at the level of the Internet service provider. 

Figure 3C is a schematic diagram illustrating a third embodiment of the 
systems and methods of the invention, wherein an advertisement is selected and 
inserted into an information document at the client system. 

Figure 4 is a flow diagram depicting selected steps of the methods associated 
with Figures 3 A-3C. 

Figure 5 is a schematic diagram showing a further embodiment of the systems 
and methods of the invention, wherein information classified under specified 
categories is selected, retrieved, and displayed based at least in part on the television 
viewing habits of the recipient. 

Figure 6 is a schematic diagram fiirther illustrating a television monitoring 
module and associated elements of the systems of the invention. 

DETAILED DESCRTPT tON OF THE PREFERRED EMBODIMENTS 

The present invention relates to selecting and displaying advertisements or 
other information on a display device of an information retrieval system based at least 
in part on the television viewing habits of the recipient. A client terminal or the like 
monitors the television viewing habits of the redpient, which are included in a user 
profile. The user profile, in combination vnth selection criteria, may be used to select 
advertisements for display to the recipient. When the recipient requests an 
information document using the information retrieval system or when an information 
document is otherwise delivered to the client terminal, the selected advertisement is 
mserted into the information document and is displayed to the recipient. 

The invention is described below by using diagrams to illustrate either the 
structure or processing of embodiments used to implement the system and method of 
the present invention. Using the diagrams in this manner to present the invention 
should not be construed as limiting of its scope. The embodiments of the present 
invention may comprise a special purpose or general purpose computer including 
various computer hardware, as discussed in greater detail below. The embodiments 
may further comprise multiple computers linked in a network environment. 
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Embodiments within the scope of the present invention include computer 
readable media having computer-executable instructions or data fields stored thereon. 
Such computer readable media can be any available media which can be accessed by 
a general purpose or special purpose computer. By way of example, and not 
limitation, such computer readable media can comprise RAM, ROM, EEPROM, CD- 
ROM or other optical disk storage, magnetic disk storage or other magnetic storage 
devices, or any other medium which can be used to store the desired computer- 
executable instructions or data fields and which can accessed by a general purpose or 
special purpose computer. Combinations of the above should also be included within 
the scope of computer readable media. Computer-executable instructions comprise, 
for example, instmctions and data which cause a general purpose computer, special 
purpose computer, or special purpose processing device to perform a certain function 
or group of fiinctions. The computer-executable instructions and associated data 
fields represent an example of program code means for executing the steps of the 
15 invention disclosed herein. 

Figures 1 and 2 and the following discusaon are intended to provide a brie^ 
general description of a suitable network and computing environment in which the 
invention may be implemented. Altiiough not required, tiie invention will be 
described in the general context of computer-executable instructions, such as program 
modules, being executed by a personal computer. Generally, program modules 
mclude routmes, programs, objects, components, data structures, etc. that perform 
particular tasks or implement particular abstract data types. The invention will also be 
described by making reference to information documents, which generally indude or 
are defined by encoded data structures stored in a computer-readable medium or a 
computer memory device. The encoded data structures of documents typically 
represent text, graphical images, audio, or other information that may be 
communicated to a user, and generally may be generated, edited, displayed and/or 
stored using a computer. The information documents may be Web pages or other 
Internet resources. 

For illustration purposes, the invention is described herein in reference to the 
Internet, which represents one example of information retrieval systems that are 
compatible with the invention. However, the principles disclosed herein are also 



20 



25 



8 



applicable to other information retrieval systems. Accordingly, H is to be understood 
that the invention is not to be limited to the Internet. Those skiUed in the art will 
understand how to implement the invention in other information retrieval systems 
upon learning of the information disclosed herein. 

Figure 1 illustrates one embodiment of the architecture of an information 
retrieval system in which the invention may be implemented. In this embodiment, 
multiple cUents systems 10 communicate with a modem pool 12 by means of direct- 
dial, bi-directional data comiections 14. which may be conventional telephone lines. 
ISDN connections, comiections supported by cable television providers, or any other 
suitable communications chamiel. Modem pool 12 may be any com^entional modem 
pool, such as those that are currently used for providing access to the Internet and 
other wide area networks. For example, modem pool 14 may be provided by a local 
ISP. Thus, modem pool 14 may be coupled to a number of server computers, such as 
remote servers 16, via a conventional network infrastructure, which may be Internet 
infrastructure 18. 

Figure 1 fiirther iUustrates an example of combining information retrieval over 
the Internet with television viewing. At least some of client systems 10 are associated 
Mdth display devices 20 that serve a dual fimction. First, display devices 20 display 
graphical, computer-generated or computer-transmitted information provided by 
client systems 10. Web pages retrieved from remote servers 16 represent one 
example of the graphical information that may be displayed on display devices 20. 
Second, television programming transmitted from television programming source 22 
may also be displayed on display devices 20. Television programming source 22 may 
be any desired television broadcaster or delivery system. Accordingly, display device 
20 may be a conventional television or may instead be a computer monitor adapted to 
display television programming. Indeed, the cUent system is optionaUy integrated m a 
television, or instead may be a self^x^ntained unit. The invention extends to systems 
incorporating the information retrieval systems disclosed herein in combination with a 
home entertainment system including a television or another display device 20. It is 
also noted that cUent terminal 24 is defined herein to include the client system and the 
display device. 
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Figure 2 depicts selected elements of one embodiment of a client system that 
may be used to implements portions of the invention. Client system 10 uses hardware 
and computer-executable instructions for providing the user with a graphical user 
interface, by which the user can access Internet resources, send and receive e-mail, 
and optionally receive other information services. Operation of client system 10 is 
controlled by a central processing unit (CPU) 26, which is coupled to an q)plication- 
spedfic integrated drcuit (ASIC) 28. CPU 26 executes computer-executable 
instructions designed to implement features of client system 10, including some of the 
steps of methods of the present invention. ASIC 28 contains circuitry which is used 
to implement certain functions of client system 10. For example, ASIC 28 may be 
coupled to an audio digital-to-analog converter 30 and to a video encoder 32, which 
provide audio and video output, respectively, to display device 20 of Figure 1. 

Client system 10 may further include an IR interfece 34 for detecting infrared 
signals transmitted by a remote control input device, such as a hand-held device or a 
wireless keyboard. In response to the infrared signals, IR interface 34 provides 
corresponding electrical signals to ASIC 28. Alternatively, the signals transmitted by 
remote control device 14 may be selected from another suitable region of the 
spectrum. A standard telephone modem 36 and an ISDN modem 38 are coupled to 
ASIC 28 to provide connections to modem pool 12 and, via the Internet 18, to remote 
servers 16. While the client system illustrated in Figure 2 includes both a telephone 
modem and an ISDN modem, either one of these devices is sufficient to support the 
communications of the client system. Furthermore, in other embodiments, modems 
36 and 38 may be supplraiented or replaced with cable modem 40 or another suitable 
communications device. In other environments, conmiunication may instead be 
established using a token ring or Ethernet connection. 

Also coupled to ASIC 28 are a mask read-only memory (ROM) 42, a flash 
memory 44, and a random access memory (RAM) 46. Mask ROM 42 is non- 
programmable and provides storage of computer-executable instructions and data 
structures. Flash memory 44 may be a conventional flash memory device that can be 
programmed and erased electronically. Flash memory 44 may store Internet browser 
software as well as data structures. In one embodiment, a mass storage device 48 
coupled to ASIC 28 is included in client system 10. Mass storage device 48 may be 
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used to supply computer-executable instructions and data structures to other 
components of the client system or to receive data downloaded over the network. 
Mass storage device 48 may include any suitable medium for storing computer- 
executable instructions, such as magnetic disks, optical disks, and the like. 

Application software and associated operating system software are stored in 
flash memory 44, or instead may be stored in any other suitable memory device, such 
as mask ROM 42 or mass storage device 48. The computer-executable instructions 
that, according to one embodiment of the invention, are used to monitor television 
viewing habits of a user and to construct a user profile that forms at least part of the 
basis for selecting advertisements are executed by CPU 26. In particular, CPU 26 
executes sequences of instructions contdned m one or more of mask ROM 42, flash 
memory 44, and RAM 46 to perform certain steps of the present invention that will be 
more specifically disclosed hereinafter. 

In one embodiment of the invention, client system 10 is a WebTV client box 
manufactured by WebTV Networks, Inc. of Palo Alto, California. One reason that 
WebTV client boxes may be convenientiy used with the invention is that they include 
tdevision interfece features that combine Internet browsing with television viewing. 
For example, the display device that is typically used to graphically display Web 
resources retrieved by a WebTV system is a conventional television. Furtiiermore, 
WebTV client boxes may be adapted to monitor television viewing habits as fiirther 
disclosed herein. Alternatively, client system 10 may be any of a variety of systems 
for providing access to the Internet or other information retrieval systems. When a 
WebTV client box is used as client system 10, the network architecture illustrated in 
Figure 1 may fiirther include a dedicated server 50, which is dedicated to providing 
information specifically to WebTV clients boxes. 

The elements of client system 10 are not limited to those depicted in Figure 2. 
For example, the invention may be used with other computer system configurations, 
including personal computers, hand held devices, multiprocessor systems, 
microprocessor-based or programmable consumer electronics, network PCs, 
minicomputers, mainfi-ame computers, and the like. The invention may also be 
practiced in distributed computing environments other than the network environment 
of Figure 1. For example, the invention may be used in any suitable network 



wo 00/54504 



11 

environment where tasks are performed by remote processing devices that are linked 
through a communications network. 

Figures 3A-3C illustrate three embodiments of the invention, wherein 
advertisements are selected and inserted into an information document based at least 
5 in part on television viewing habits of the recipient. In general, the embodiments of 
Figures 3A-3C are configured to monitor the television viewing habit of a user of the 
client system and to construct a user profile that includes the television viewing 
habits. Based at least in part on the television viewing habits, an appropriate 
advertisement is selected according to advertisement selection criteria. The selected 

10 advertisement is inserted into an Internet document and is displayed to the user on the 
display device. Advertis^ent sdection and insertion is conducted at the remote 
server in Figure 3 A and at the Internet service provider and the client system in Figure 
3B and 3C, respectively. 

Turning now to Figure 3 A, television programming source 22 broadcasts a 

15 tde^dsion programming feed that is displayed to the user on display device 20. A 
television monitoring module 52 at client system 10 has access to the television 
programming feed and detects the identity or the content of the television 
programming used by the user. A more detailed description of one embodiment of a 
television monitoring module is disclosed herein in reference to Figure 6. 

20 A user profile 54 compiled at client system 10 is a profile of the user of the 

client system 10 and includes at least information relating to the television 
programming displayed on display device 20. User profile 54 may also include other 
user information fiirther characterizing the user. Examples of such user information 
include demographic information, Internet usage data, geographical information, or 

25 other identifying information. U.S. Patent Application Serial No. 09/094,851, filed on 
June 15, 1998, discloses user profiles and specific example of user information, many 
of which may be included in the user profiles of the present invention. For purposes 
of disclosure, the foregoing patent application is hereby incorporated by reference. 

The information included in user profile 54 may be compiled over any desired 

30 period of time. For example, user profile 54 may be updated each time the user views 
a television program. Information relating to viewed television programming may be 
retained in user profile 54 for a set period of time. According to one option, the most 
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recently viewed television programming is given more weight in user proffle 54 than 
older programming. Alternatively, user profile may include information relating to 
only the most recently viewed television programming. 

Client system 10 provides Internet access to the user by means of an Internet 
browser 56, which may be any conventional or other Internet browser that is adapted 
or otherwise capable of transmitting information included in user profile 54 as fiirther 
described herein. For example, when cUent system 10 is a WebTV client box, 
Internet browser 56 is the Internet browser typically included in WebTV cUent boxes, 
with the browser being adapted to transmit user profile information. The Internet 
browser 54 included in client system 10 is one example of means for requesting an 
information document fi-om a server computer. 

A user enters commands to cUent system using input device 58, thereby 
requesting an information document fi-om remote server 16. When cUent system 10 is 
a WebTV client box, input device 58 may be a handheld remote control device or a 
wireless keyboard that aUows the user to select and retrieve desired Internet resources. 
Altematively, the mput device may be a keyboard, a mouse, or another device that is 
conventionaUy used to provide user input to an Internet browser. It is noted that a 
user may access the Internet by means of the Internet browser 56 at any time after 
having viewed television programming on display device 20. For example, the user 
may interrupt television viewing to access the Internet or, altematively, may access 
the Internet some time after having stopped watching television programming. 

The Internet browser sends a uniform resource locator (URL) via Internet 
service provider 60 to a document retrieval module 62 at remote server 16. For 
example, the network architecture by which client system 10 communicates with 
remote server 16 may be that disclosed in Figure 1. Methods and systems for 
retrieving an information document over the Internet or other information retrieval 
systems are well known in the art. In the embodiment of Figure 3A, wherein 
advertisement selection and insertion into the information document is conducted at 
remote server 16, cUent system 10 further sends information fi-om user profile 54 to 
an advertisement selection decision unit 64 at remote server 16. As previously noted, 
the information user profile 54 identifies the television viewing habits of the user of 
client system 10. 
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In this embodiment, remote server 16 includes features for providing a 
plurality of advertisements and for selecting and inserting an advertisement into the 
requested information document. In one implementation, an advertisement source 66 
supplies a plurality of advertisements that are stored in advertisement repository 68. 
In one embodiment, advertisement source 66 and remote server 16 may be operated 
by the same party. Alternatively, advertisement source 66 may be operated 
independently from remote server 16 and located at a remote site. The pluraUty of 
advertiswnents provided by advertisement source 66 may be assodated with a wide 
variety of advertisers and goods and services. 

In this embodiment, remote server 16 fiirther includes advertisement selection 
criteria 70, which, in conjunction with the user profile information, govern the 
selection of an advertisement stored in advertisement repository 68. For wcample, the 
selection criteria may provide that an advertisement whose subject matter corresponds 
to the television viewing habits of the user is to be selected. Optionally, 
advertisement selection criteria 70 further incorporates any of the conventional 
techniques for selecting advertisements, including selecting an advertisement to 
correspond to the subject matter of the requested information document. 

Remote server 16 retrieves requested information document 72 from a 
document cache 74 according to methods that will be understood by those skilled in 
the art. The information document 72 may be provided by a content provider who is 
also the operator of remote server 16. Alternatively, the content provider who 
provides information document 72 may be an entity that purchases information 
document posting services from the operator of remote server 16. Information 
document 72 may be any Internet resource or another computer-displayable or 
computer-transmitted data structure. For example, Hyper-Text Markup Language 
documents ("HTML documents") are commonly retrieved over the Internet and are 
particularly suited for use with the invention. 

An advertisement insertion module 76 inserts data representing selected 
advertisement 78 into uiformation document 72 after it is retrieved. For example, the 
selected advertisement may be embedded in the information document 72 according 
to conventional techniques. After tiie selected advertisement is inserted, the requested 
information document 72 is transmitted from remote server 16 to client system 10. 
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Internet browser 56 displays the information document 72 and the selected 
advertisement 78 on display device 20, which is one example of means for displaying 
the information document. In this manner, the user of the client system views an 
advertisement that is determined to be appropriate based at least in part on the 
television viewing habits of the user. Selecting and inserting the advertisement at the 
remote server is advantageously compatible with current techniques of advertisement 
insertion, vAdch are also conducted at the remote server. 

Figure 3B illustrates an embodiment of the invention wherein advertisement 
selection and insertion are conducted at the level of the Internet service provider. 
Television programming is viewed by the user and a user profile 154 is compUed at 
client system 110 in much the same way as described herein in reference to Figure 
3A. When a user requests an information document fi-om a remote server according 
to this embodiment, the URL is transmitted to the remote server via a request router 
80 at the Internet service provider 160. The user profile, however, is transmitted to 
and stored at Internet service provider 160. Information fi-om user profile 154 may be 
transmitted each time the user requests resources fiiom the Internet, at the beginning of 
eadi Internet session that is served by Internet service provider 160, or periodically at 
any desired interval. For example, client system 110 may update user profile copy 
154' on a daily basis, regardless of whether the user has accessed the Internet during 
the day. Furthermore, Internet service provider 160 may maintain user profile 
information associated with a plurality of cUent systems. The method of selecting 
advertisements at Internet service provider 160 may be substantially similar to the 
methods for selecting advertisements at remote server 16 described in reference to 
Figure 3A. Alternatively, advertisement selection dedsion unit 164 may select 
appropriate advertisements for client system 110 and compile a list of appropriate 
advertisements before any information document is requested by client system 110. 
In this case, the preselected advertisements are ateady identified and available for 
insertion into requested information documents when the user begins to access to the 
Internet. 

Advertisement insertion module 176 of Figure 3B may insert the selected 
advertisement into the requested information document according to one of at least 
two methods. First, the information document transmitted fi-om remote server 1 16 to 
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Internet service provider 160 may include a vacant field or anther location to which 
the selected advertisement may be added. Second, advertisement insertion module 
176 may overwrite an advertisement already included in the requested information 
document, thereby replacing the existing advertisement with the selected 
5 advertisement. 

The requested information document, including the selected advertisement, is 
next transmitted firom Internet service provider 160 to the Internet browser 156 at 
dient system 110. The information document and the selected advertisement may be 
displayed at display device 120 according to the methods disclosed in reference to 

10 Figure 3 A. According to the embodiment of Figure 3B, the user receives 
advertisements selected based at least in part on the television viewing habits of the 
user. Selecting and inserting the advertisements at the level of the Internet service 
provider have the advantage of allowing a periodically updated copy of the user 
profile to be stored at the Internet service provider. Accordingly, the Internet service 

15 provider may preselect advertisements for the users of a plurality of client systems. 

Figure 3C illustrates a fiirther embodiment of the invention, wherein 
advertisements are selected and inserted at the client system. The methods and 
systems for viewing television programming, monitoring the television programming, 
and compiling a user profile may be substantially similar to those disdosed in 

20 reference to Figures 3A and 3B. In this embodiment, however, the advertisement 
selection decision unit 264, the advertisement repository 268, and the advertisement 
selection criteria 270 are located at the client system 210. The user requests an 
information document firom remote server 216 via Internet service provider 260 
according to methods that may be similar to those disclosed in reference to Figures 

25 3A and 3B, with the exception that user profile information does not need to be 
transmitted firom client system 210. In particular, a selected advertisement 278, which 
may be identified before the user requests any Internet resources fi-om the remote 
server, may be inserted into retrieved information document by Internet browser 256. 
As described in reference to Figure 3B, selected advertisement 278 can be 

30 inserted into the information document at a vacant field, or instead may replace an 
advertisement aheady included in information document. The information document 
with the selected advertisement embedded therein is then displayed to the user on 
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display device 220 according to the methods disclosed herein. According to this 
embodiment, the advertisements are selected and inserted without transmitting any 
mformation relating to television viewing habits from client system 210. Because the 
Internet service provider and the remote server do not have access to the television 
viewmg habits of the user, the privacy of the user with respect to television habits is 
maintained. 

Figure 4 is a flow chart depicting selected steps of the methods associated with 
Figures 3A.3C. ^ step 410. the user views television programming, and the subject 
matter of the television programming is monitored at the cUent system In step 412. 
the user profile, including information relating to the television viewing habits of the 
user, is compiled at the client system. The user requests an information document, 
such as a Web page, using an Internet browser at the client system as illustrated by 
step 414. In step 416. an advertisement determined to be appropriate based at least in 
part on the user profile is selected for insertion into the requested information 
document. The selected advertisement is tiien inserted in step 418 into the 
information document. Steps 416 and 418 may be conducted at the remote server, the 
Internet service provider, or the cUent system as disclosed in reference to Figures 3A- 
3C. FinaUy. ti,e requested information document, including a selected advertisement. 
IS displayed to the usa- according to step 420. 

Figure 5 iUustrates a further embodiment of the imrention. wherein any type of 
mformation may be selected and displayed to a user based at least in part on the 
television viewing habits of the user. For example, the information displayed to the 
user may be news, educational resources, advertising, entertainment, or any other 
desired type of information. In one implementation, tiie information retoieval system 
automatically provides and displays reference information relating to tiie content of 
the television programming viewed by the user. For example, the reference 
^formation may include reviews, information about tiie cast, and other items of 
interest to television viewers. 

According to the embodiment of Figure 5. a television programming source 
322 provides a television programming feed to display screen 320 according to 
methods described in reference to Figures 3A.3C. Furthermore, television monitoring 
module 352 detects the identity or content of the television programming viewed by 
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the user and stores information relating thereto in progranuning information 
repository 382. For example, the programming information may identify one or more 
topics associated with the television programming. In this embodiment, client system 
310 further includes a list of information categories 388, each being associated with 
information documents stored in a document cadie 374 at remote server 316. A 
category selection module 384 compares the programming mformation with the 
information categories to select at least one information category 386 that corresponds 
to the television programming viewed by the user. The comparison of the 
programming information with the information categories 388 may be fadlitated by 
selection criteria similar to the advertisement selection criteria disclosed in reference 
to Figures 3A-3C. By way of example, and not by limitation, the selection criteria 
may provide that a selected information category 386 is identified by looking for a 
direct match between a keyword in the programming information and a keyword in 
information categories 388. 

When selected category 386 is identified, Internet browser 356 transmits a 
request to remote server 316 via Int^et service provider 360 for one or more 
information documents assodated with the selected category. Document retrieval 
module 326 then retrieves one or more information documents fi-om document cache 
374. These information documents are then downloaded to Internet browser 356 and 
displayed on display device 320. According to one option, the information document 
may be displayed on display device 320 simultaneously wth the television 
programming. For example, the information document may be overiaid on a selected 
region of the display device 320 or the display device may be divided into a 
split-screen arrangement. According to another option, the information documents 
are displayed on display device 320 only when the television programming feed to 
display device 320 is terminated or \^en the user affirmatively indicates that it is 
appropriate to display the information documents. 

Information categories 388 may be further tailored or narrowed to correspond 
to the viewing habits of the particular user, periodically updated from a remote source 
such as remote server 316, or selected by the user. For example, if it is noted that a 
user repeatedly views television programming related to sports, the information 
categories can be supplemented with subcategories relating to more narrow sports 
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topics. One method offurthertaUoringinfomation categories 388 to con-espond to 
frequently viewed topics involves using a user profile simUar to those described in 
reference to Figures 3A-3C. For example, a user profile indicating that the user 
frequently views particular sporting events may be used to retrieve subcategories from 
a remote server, which then can supplement the standard infonnation categories 388. 
Direct user input may also be used to select or fiirther refine information categories 
388. This may be accomplished by providing a large list of information categories 
from which the user may pick and choose to identify the categories that are likely to 
be of most interest. 

According to this embodiment of the invention, retrieval of news, 
entertaimnent, educational resources, or other information documents based at least in 
part on the television viewing habits of the user can be conducted automatically, with 
no user assistance. Such techniques provide automatic access to information that is 
likely to be of use and of interest to the redpient. 

Figure 6 illustrates one example of a television monitoring module that may be 
used with the various embodiments of the invention. In this example, television 
programming source 22 broadcasts closed-captioning infonnation 90 in addition to 
standard programming 92. Closed-captioning information 90 is routed to a closed- 
captioned monitoring unit 94, which detects keywords or otherwise determines the 
subject matter of the television programming 92 based on the closed-captioning 
information 90. 

Additionally, television monitoring module 52 accesses an electronic 
programming database ("EPD") 96 that includes written or encoded descriptions of 
the subject matter of television programming 92. Based on the information from 
electronic database 96. EPD monitoring unit 98 determines the subject matter of 
programming 92. Closed-captioning monitoring unit 94 and EPD monitoring unit 98 
update user profile 54 with the identified subject matter of the programming 92. For 
example, television monitoring module 52 may have access to a plurality of 
programming categories similar to infonnation categories 388 of Figure 5. In this 
case. EPD monitoring unit 98 and closed-captioned monitoring unit 94 identify one or 
more programming categories 100 that best coirespond to the subject matter of 
programming 92 and cause these programming categories to be included in user 
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profile 54. For iUustration purposes, Figure 6 shows television monitoring module 52 
as including a closed captioning monitoring unit 94 and an EPD monitoring unit 98, 
both of which are examples of means for monitoring the television programming 
viewed by the user. However, in many instances, only one of the foregoing 
monitoring units is sufficient to identify the content of the television programming. 
Furthermore, the invention is not limited to monitoring the content of television 
programming using closed captioning information or an electronic programming 
database, but may utilize other means for monitoring the television programming. It 
is also noted that either of the closed captioning monitoring unit 94 or the EPD 
monitoring unit 98 in combination with programming categories 100 represent but 
one example of means for compiling a user profile. 

The present invention may be embodied in other specific forms without 
departing fi-om its spirit or other essential characteristics. The described embodiments 
are to be considered in all respects only as illustrative and not restrictive. The scope 
of the invention is, therefore, indicated by the appended claims rather than by the 
forgoing description. AU changes w*ich come within the range of equivalency of 
the claims are to be embraced within thdr scope. 
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1. In an information retrieval system including a server computer and a 
cUent system having a display device, wherein the client system has access to 
television programming viewed by a user of the information retrieval system, a 
method for inserting an advertisement into a document displayed on the display 
device, the method comprising the steps of 

compiling a profile of the user of the information retrieval system, 

including at least information associated with the television programming 

viewed by the us«-; 

requesting, by the cliem system, an information document from the 
server computer; 

selecting, based at least in part on the profile and on designated 
selection criteria, an advertisement from among a phirality of advertisements 
for insertion into the information document; 

inserting data representing the selected advertisemem into the 
information document; and 

displaying the information document, including the selected 
advertisement, on the display device. 

2. A method as defined m claim 1, wherein the step of inserting data 
representing the selected advertisement is conducted at the server computer. 

3. A metiiod as defined in claim 1, wherein the step of inserting data 
representing tiie selected advertisement is conducted by an Internet service provider. 

4. A metiiod as defined in claim 1, wherein the step of inserting data 
representing the selected advertisement is conducted at the client system. 

5. A metiiod as defined in claim 4, fiirtiier comprising, before die step of 
selecting an advertisement, tiie step of receiving the plurality of advertisements at tiie 
client ^stem. 

6. A metiiod as defined in claim 5, fiirtiier comprising the step of storing 
the pluraUty of advertisements at the client system after the step of receiving the 
plurality of advertisements. 

7. A method as defined in claim 1, wherein the information document is 
an HTML document. 
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8. A method as defined in claim 1, wherein the step of compiling the 
profile includes the step of including in the profile user information fiirther 
characterizing the user, m addition to the tdevision programming viewed by the user. 

9. In an information retrieval system including a server computer and a 
5 client system having a display device, wherein the client system has access to 

television programming viewed by a user of the information retrieval system, a 
method for inserting an advertisement into a document displayed on the display 
device, the method comprising the steps of: 

compiling a profile of the user of the information retrieval system at 
10 the client system, the profile including at least information associated with the 

television programming viewed by the user; 

transmitting the profile from the client system to the server computer; 
requesting, by the dient terminal, an information document from the 
server computer, 

15 selecting, by the server computer, an advertisement from among a 

plurality of advertis^ents for insertion into the information document, the 
advertisement being sdected based at least in part on the profile and on 
designated selection criteria; 

inserting, by the server computer, data representing the selected 
20 advertisement into the information document; 

transmitting the information document, including the data, to the client 
system; and 

displaying the information document, including the selected 
advertisement, on the display device. 
25 10. A method as defined in claim 9, wherein the step of compiling the 

profile comprises the step of identifying content of the television programming using 
an electronic television programming database having a content description 
corresponding to the television programming. 

11. A method as defined in claim 9, wherein the step of compiling the 
30 profile comprises the step of identifying content of the television programming by 
monitoring closed captioning mformation associated with the television 
programming. 
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12. A method as defined in claim 9, wherein the step of compiling the 
profile comprises the step of including demographic information associated with the 
user in the profile. 

13. In an information retrieval system including a server computer and a 
5 client system having a display device, wherein the client system has access to 

television programming viewed by a user of the information retrieval system, a 
method for displaying information on the display device in response to the television 
programming, the method comprising the steps of: 

monitoring, by the client system, television programming viewed by 
10 the user of the information retrieval system; 

comparing the television programming viewed by the user to a 
plurality of information categories to identify at least one information category 
that corresponds, according to designated selection criteria, with the television 
programming; 

15 requesting, by the client system, an information document classified 

under the at least one identified information category fi-om the server 
computer; and 

displaying the information document on the display device. 

14. A method as defined in claim 13, wherein the information document 
20 includes news. 

15. A method as defined m claim 13, wherein the information document 
includes reference information relating to the content of the television programming. 

16. A method as defined in claim 13, fiirther comprising, prior to the step 
of comparing the television programming viewed by the user to the plurality of 

25 information categories, the step of selecting the plurality of information categories 
based in part on user input. 

17. A method as defined in claim 13, fiirther comprising, prior to the step 
of comparing the television programming viewed by the user to the plurality of 
information categories, the step of selecting the plurality of information categories 

30 based at least m part on a profile of the user. 

18. A method as defined in claim 17, wherein the profile includes 
information associated with the television programming viewed by the user. 
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19. A method as defined in claim 13, wherein the step of requesting an 
information document is conducted without direct user assistance. 

20. A computer program product for implementing a method of displaying 
an information document including an advertisement selected at least in part on 
television programming viewed by a user of an information retrieval system, wherein 
the method is implem^ted in a client system of the information retrieval system, the 
computer program product comprising: 

a computer-readable medium carrying computer-executable 
instructions for implementing the method, v^erein the computer-executable 
instructions comprise: 

program code means for monitoring television programming 
viewed by the user; 

program code means for compiling a user profile, vv^^-ein the 
user profile includes information associated with the television 
progranmiing viewed by the user; 

program code means for requesting an information d ocument 
fi'om a server computer; and 

program code means for displaying the information document 
ha\dng the advertisement included therem, wherein the advertisement 
has been selected firom a plurality of advertisements based at least in 
part on the user profile. 

21. A computer program product as defined in cldm 20, wherein the 
computer-executable instructions fiirther comprise program code means for initiating 
transmission of the user profile to the server computer, wherein the advertisement is 
selected fi-om the plurality of advertisements at the server computer. 

22. A computer program product as defined in claim 20, wherein the 
computer-executable instructions fiirther comprise program code means for initiating 
transmission of the user profile to an Internet service provider, wherein the 
advertisement is selected fi'om the pluraUty of advertisements at the Internet service 
provider. 
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23. A computer program product as defined in cldm 20, wherein the 
computer-executable instructions further comprise program code means for selecting 
the advertisement fi-om among the plurality of advertisements at the client terminal 

24. A computer program product as defined in claim 23, wherein the 
5 computer-executable instructions further comprise program code means for receiving 

the plurality of advertisements from an advertisement source and storing the plurality 
of advertisements at the client system. 

25. A computer program product as defined in cldm 23, wherein the 
computer-executable instructions further comprise program code means for inserting 

10 data representing the selected advertisement mto the information document. 

26. A computer program product as defined in claim 20, wherein the 
program code means for monitoring television programming comprises program code 
means for monitoring an electronic programming database that includes content 
descriptions assodated with the television programming. 

27. A computer program product as defined in claim 20, \\4ierein the 
program code means for monitoring televiaon programming comprises program code 
means for monitoring closed captioning mformation associated with the television 
programmmg. 

28. A system configured to display an information document including an 
20 advertisement selected at least in part on television programming viewed by a user of 

the system, the system comprismg: 

a home entertainment system for pro\iding the television progranmiing 
viewed by the user, including: 

a television programming feed for delivering the television 
25 programming; and 

a television for displaying the television programming; and 
an information retrieval system including: 

means for monitoring the television programming viewed by 
the user; 

means for compiling a user profile, including at least 
information associated with television programming viewed by the 
user; 
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means for requesting an information document from a server 
computer; and 

means for displaying the information document having the 
advertisement included therein, wherein the advertisement has been 
selected from a plurality of advertisements based at least in part on the 
user profile. 

29. A system as defined in claim 28, wherein the means for displaying the 
information document comprises the television of the home entertainment system. 

30. A system as defined in claim 28, wherein the means for requesting an 
information document comprises an Internet browser. 

31. A system as defined in daim 28, wherein the means for monitoring the 
television programming viewed by the user comprises an electronic programming 
database monitoring unit. 

32. A system as defined in claim 28, wherein the means for monitoring the 
television programming viewed by the user comprises a closed captioning monitoring 
unit. 
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